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(57) A volumetric data representation for graphical 
objects encodes the distance of data elements to the 
nearest object surface, with means being provkied for 
estimating the direction an magnitude of surface nor- 
mals from the distance values. The subject system can 
be used to accurately reconstruct the normal direction 
of a slowly varying surface in volume sanpled data for 
high quality Volume Rendering, accurate force reflection 
in haptic feedback, and accurate force calculation and 
object penetration estimation in physically-based graph- 
ics. 
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Description 

FIELD OF THE INVENTION 

5 [0001 ] This invention relates to Volume Graphics and more specif tcally to a disaete object representation that allows 
accurate reconstruction of surface normals for Volume Rendering, haptic exploration of volumetric models using force 
feedback, and physically-based calculations of interactions between graphical objects. 

BACKGROUND OF THE INVENTION 

10 

[0002] In Volume Graphics, objects are represented as arrays of sampled data elements. Volumetric object represen- 
tations have some advantages over surface-l)ased graphical object representations because they can represent object 
interiors. This \s important both for visualizing the internal structure of conr^Iex objects and for physically-based mode- 
ling of actions such as object defonration or the cutting and tearing of volumetric objects. Using volumetric object rep- 

15 resentations to model physicallyHaased object interactions is discussed, for example, by S. Gibson in "Beyond volume 
rendering: visualization, haptic exploration, and physical modeling of voxel-based objects", in Proc. Eurographics work- 
shop in Visualization in Scientific Computing, pp. 10-23. Chia. Italy. 1995. Using a volumetric dDject representation to 
model object deformation is discussed by S. Gbson in "3D ChainMail: a fast algorithm for deforming volumetric 
objects", in Proc. Symposium on Interactive 3D Graphics, Providence. Rl, pp. 149-154, 1997. 

20 [0003] Volume Rendering is technique used for displaying volumetric objects on a 2D computer monitor. There are 
several approaches to Volume Rendering, including ray casting where rays from ea<^ pixel in the image plane are cast 
into the object accumulating color as they pass through the volumetric object; arxl splatting where each element in the 
object is projected onto the image plane, contrftxiting color to the rendered image. For Volume Rendering, information 
about the color, transparency, surface normal, and material reflectance properties for each volume element are needed. 

25 These are often derived from two values stored for each element: a measured sample intensity or densrty value, and a 
material classification. For example, the density value might be used to calculate the element's opacity and surface nor- 
mal, while the classification might be used to assign colors and reflectance properties to object elements. 
[0004] In computer graphics, the quality of a rendered image is greatly improved by adding an illumination model to 
the rendering process. An illumination model allows the calculation of lighting effects such as spot lighting from specific 

30 light sources, reflections from object surfaces, and shadows. In computer graphics, a typical illumination model is the 
Phong illumination model, which expresses the light reflected from an object surface as follows: 

I r = Ul obi + K , I J ^j(NL) + K J J ^j(RV) 

35 where Ip lobj- and ^ are the reflected, ambient object and fight source colors. K^, Ka. and are the ambient, diffuse, 
and specular reflection coefficients, N is the surface normal of the object. L is the direction of the light source. V Is the 
viewing direction, and R is a function of N and L 

[0005] In the Phong illumination rrxxlel, an accurate representation of the object surface normal is essenUal. Inaccu- 
rate surface normals can have a farge effect on the perceived shape arxl texture of a graphical object. Since, in most 
40 graphical representations, the surface normal is taiown accurately at only a relatively small number of positions, esti- 
mating the surface normal at arbitrary object positions is very important for high quality rendering. In Volume Graphics, 
estimating surface normals is especially challenging because accurate surface normals are not usually stored in the 
date. Instead, surface nonmals are usually estimated from date intensity or density values. 

[0006] ft is inportant to note that the calculation of accurate surface normals in Volume Graphics is not only needed 
45 for Volume Rendering. An accurate surface normal estimation is essential for haptic date exploration where a force 
feedback device is used by the user to factually explore the surface of a graphical object Accurate surface normal esti- 
mation is essential in this application because the sense of touch is even more sensitive than the eye to surface irreg- 
ularities. An accurate surface normal is also important in modeling physically-lased interactions between objects 
because the calculation of Impact and frictional forces between (Ejects d^ends on these normals. 
so [0007] Many methods have been used to add lighting effects, or shading, to Volume Rendered images. These meth- 
ods depend on the date representetion. Different methods are used when the date is represented as a binary field 
where date sanples are either empty or full of a given mata-ial, or as a sampled continuous field, such as a sampled 
intensity or material der^ field. Many methods for shading volumetric objects are discussed, for example, in "Volume 
Visualization", edited by Arie Kaufman, and published by the IEEE Computer Society Press, Los Alamos, CA, in 1991 . 
55 The more sophisticated of these methods require surface normal e^mates at sampled date points. 

[0008] In order to estimate surface normals when the object is represented as sampled continuous field. Volume Ren- 
dering often takes advantege of the fact that the image intensity or n^terial density values change fastest at object sur- 
faces. The (firectional change in image intensity can be represented by the 3D image gradient vector, which, at any 
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image position, points in the direction of fastest change in intensity values and which has a niagnitude proportional to 
surface strength. Hence, this gradient vector is often used in Volume Rendering to estimate surface nonnals fcjr iilumi- 
natioa 

[0009] There are many ways to estimate image gradient vectors from sampled data. One straight-fonward method is 
called the central difference method. Here the gradient vector, (g,. Qz.) is estimated from the 3D image intensity I (x. 
y. z) by: 

g^ = l(x+1.y.z)-l(x-1.y.z). 



gy = l(x.y+1.z)-l(x.y-1.2). 
g^ = l(x.y.z+1)-l(x.y.z-1). 

[001 0] Other image gradient operators include Sobel operators, cosine fitters, and more complex filters such as those 
discussed by S. IWlarschener and R. Lotib in *An evaluation of reconstruction filters for Volume Rendering". Proc. IEEE 
Visualization "OA. pp. 100-107. Washington. DC. 1994. by T. Moller. R. Ktechiraju. K. t^/lueller. and R. Yagel in "Evaluation 
and design of fiitefs using a taytor series expansion". IEEE Transactions on VisuaHzation and Computer Graphics. Vol. 
3. No. 2. pp. 184-199. 1997. arel by M. Bentum. B. Uchtenbelt. and T Malzbender in "Frequency analysis of gradient 
estimators in volume rendering". IEEE Transactions on Visualization and Computer Graphics. Vol. 2. No. 3. pp. 242- 
254. 1996. 

(001 1 ] S. Wang and A. Kaufman calculate smooth surface nwmals from volumetric data in "Volume-sampled 3D mod- 
eling", in IEEE Computer Graphics and Applications, pp. 26-32. 1994. They start with binary segmented data and 
the apply a Gaussian filter to the object intensity or density values. They then estimate surface nomials as the gradient 
of this smoothed image. 



SUMMARY OF THE INVENTION 

[001 2] In contradistinction to the above methods, in the subject invention, a volumetric distance map in which dis- 
tances to the nearest object suifece are stored for each volume element or vojffll. is used to improve the surface normal 
estimation for volumetric objects. After having aeated a discrete volumetric distance map. one can calculate a gradient 
vector of the distance field for any point in the volume. Because the gradient vector derived from this distance map 
points in the direction of the surface, it provides the surface normal direction. The distance itself can be used to derive 
the surface nomial magnitude. ^ ^ • ■ « 

[001 31 While others have used volumetric distance maps in Volume Rendering, they have been used exclusively lor 
speeding up the ray-casting rendering algorithm. The distance value are used in these systems as minimum distances 
to the next non-empty volume elements to adjust the step size along rays as they are cast into the sul^ect. Two resear* 
papers that use a volumetric distance map to accelerate Volume Rendering are "Acceleration of ray-casting using 3D 
distance transforms", by K ZuideweW. A. Kbning and M. Viergever in Proc. Visualization in Biomedical Computing. 
Chapel Hni. NC. pp. 324-335. 1992 and "Ret surface rendering from raster data by voxel transversal using chessboard 
distance", by M*. Sramek in Proa IEEE VisuaTizafion -94. pp. 188-195. Vteshington. DC. 1994. 
(00141 Vblumetric object representations have some advantages over surface-based graphical representations 
because they can incorporate coiiplex interior structure. This is important both for visualizing internal strocture and for 
modeling the physical behavior of 3D objects. However, in addition to interior structure, an accurate representation of 
surface is needed for high quality rendering, tor haptic modeUng. and for physics-based graphics. The subject invention 
addresses this need for an accurate representation of surfaces within volumetric data. 

[00151 One reason that » is difficult to reconstruct surfaces from volumetric intensity or density values has to do w«i 
the discrete nature of the data. Infomiation theory tells us that in order to reconstruct a signal exactiy from sampled 
data the signal must be sampled at twice the higjiest frequency consent in the signal. Since a surface represents a 
sudden change in the image intensity or density value, the image signal at a surface has infinite frequency "Jmpcirier^ 
and hence no sampling rate would be high enough for exact object reconstniction. Reconstruction enors are 'rterwRed 
with gradient estimation and these enore can lead to poor surface normal estimates and significant rendering artrtacts. 
[00161 The Gaussian filtering method of Wang and Kaufman prefiRers the image data to reduce the high frequency 
components in a data volume and hence reduce aliasing artifacts in the gradient estimation. While this approach pro- 
duces more pleasing images than those siAject to aliasing, rt also results in overly smoothed and rounded surfaces. 
[0017] The subject invention encodes, into the volumetric data, knowledge of the presence, position and stmcture of 
known surfaces. Instead of storing object intensity or density values whose values usually change suddenly and dras- 
tically across a surface, the sut)iect invention stores distances to the nearest surface element in each volumetnc ele- 
ment. In one entxxfiment. distances are positive inside the object and negative outside of the ot^ect 
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[0018] Note that: 



1 ) the gradient vector of this distance map points in the direction of the surface normal; 

2) a zero distance map value indicates the presence of a surface; and 

3) a positive distance value indicates that the sanple is inside the object The distance to the nearest surface point 
varies linearly In the direction normal to a surface, and varies slowly in the direction parallel to the surface as long 
as the surface is rdatively smooth. Hence, lower sampling rates and less complex gradient reconstruction filters 
can be used for accurate nonnal estimation with a distance map represartation than with a sanpled density repre- 
sentation. 

[001 9] It will be appreciated that in addition to using the distance map representation for calculating surface normals 
in Volume Rwidering, cBstance maps can also be used to calculate surface nonnals for haptic exploration with a force 
feedback device and fa calculating object penetration distances in interaction force calculations for physically-l>ased 
fnodeling. 

[0020] As there are many sources of data for a volumetric object representation, there are many ways to calculate the 
volumetric distance map. H the source of the data is an implicit or parametric representation of the surface, such as the 
equation of a sphere or a spline patch, then either geometric reasonir^, or a constrained optimization technique can be 
used to find the minimum distance from any point in the volume to the d^ined surface. For a polygonal surface model, 
various algorithms used in graphical collision detection can be used to calculate the distance from any point in volume 
to the nearest surface polygon. For a discretely sampled continuous field, such as a density field for which no further 
knowledge of the surface is known, one method to generate distance measures would be to construct a polygonal 
spline patch surface model at iso-surface values using a technique such as Marching Cubes, described by W. Ixrensen 
and H. dine, in "Marching Cubes: a high resolution 3D construction aJgaithm". in Proc. SIQGRAPH W, pp. 163-169. 
1987, and then calculate distance from this constructed surface. For a binary segmented ot)iect, the binary object could 
be srnoothed to form a continuous sanpled density field and then treated as above, or distance could be calculated 
from the binary segmented data using measurements such as the city-block distance or Euclidean distance approxima- 
tions that are descn*bed, for example, in The image processing handbook", by J. Russ. published by CRC Press, in 
Boca Raton, FL. 1992. The resultant distance maps coukJ also be filtered to obtain a smoother distance field. 
10021 ] "me subject system finds application in computer graphics for generating lighting effects for volume rendenng, 
for calculating reflected forces for volumetric objects in haptic rendering systems and for calculating physically-based 
response to interactions l)etween volumetric graphical objects. 

[0022] With respect to generating light effects in volume rendering, the calculation of the magnitude and direction of 
light reflected from an object's surface requires an estimate of the object surface nonral. "me subject system for calcu- 
lating surface normals provides a means for generation these light effects for discrete volumetric objects. 
[0023] With respect to calculating reflected forces in haptic rendering systems, the direction and magnitude of the 
force that is reflected in haptic rendering through use of a force feedback de/ice depends on the normal of the graphical 
object's surface at the position of the end effector of the force feedback device and the distance of the end effector from 
the object surface. The reflected forces allow one to haptically explore, or lee", the surface of the graphical object THe 
subject system of encoding distance to surface in a volumetric distance map and for calculating surface normals pro- 
vides a means for generating the required reflected force direction and magnitude. 

[0024] With respect to calculating physically-based responses to interactions between graphical objects, an interac- 
tion is detected when two objects penetrate each oth^ in a physically-based simulation, and the forces caused by the 
interaction can be calculated from the deptii of penetration of the two objects and the object surface normals at the con- 
tact point The subject system of encoding distances to surfaces in a volumetric distance map and for cateulating sur- 
face normals pix)vides a means for detecting object penetration and for generating the required interaction force 
direction and magnitude. Object penetration of one object into a second object is detected when a point of the first 
object maps to a position in the distance map of the sec object that has a distance value which indicates that the point 
is inside the second object The depth of penetration of the first object point into the second object can be calculated 
from the distance map of the second object. The depth of penetration can be combined with object surface normals cal- 
culated from the distance maps to calculate the direction and magnitude of interaction forces. 

RRIF=F DFSCP IPTION OF THE DRAWINGS 

[0025] These and other features of the Subject Invention will be better understood in relation to tiie Detailed Descrip- 
tion in conjunction with the Drawings, of which: 

Rgure 1 is a diagrammatic representation of a computer system used for high quality rendering; 
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Rgure 2 is a diagrammatic representation of vector components in the Phong illumination model; 

Figure 3A is a diagrammatic representation of the vector components used for calculating the lighting effects in a 
polygonal graphical object nnodel: 

Rgure 3B is a diagrammatic representation of a means for estimating the surface normal at a point P, on a polygo- 
nal object model; 

Rgure 4 is a flow chart of Volume Rendering using ray-casting with an illumination rrxxJei; 
Rgure 5A is a diagrammatic representation of Volume Rendering using ray-casting; 

Rgure 5B is a diagrammatic representation of the vector components needed at a ray sample point P. for calculating 
the Illumination effect: 

Rgure 6A is a typical data structure written in the C programming language for representing a volumetric element 
for Volume Rendering: 

Rgure 6B is a data stnjcture written in the C programming language that encodes both the element density and the 
20 distance map; 

Rgure 7 is a diagrammatic representation illustrating the differences between the prior art and the subject inven- 
tion for shading in Volume Rendering. wHh (a) represenfing the two dimensional graphical object, (b) rep- 
resenting the objects distance map, (c) representing the sampled version of (a), (d) representing the 
sampled version of (b), (e) depicting the gradient of (c). calculated using the central difference algorithm, 
and (f) depicting the gradient of (d), calculated using the central difference algorithm; and 

Rgure 8 is a block diagram of a system for g^erating distance maps for graphical objects from a variety of data 
sources. 

r^FTAILED DESCRIPTION 

[00261 Referring now to Rgure 1 . high quafity rendering of a graphical object 2, is perfonned on a computer 4, with 
user input from the keyboard 6. and an input device 8. and displayed on a computer monitor 10. 
[0027] Referring to Rgure 2. in computer graphics, high quality image rendering usually incorporates an illumination 
model such as the Phong illumination model which estimates the color to the light reflected at a point P from a graphical 
object as a function of the color of the object the color of the light source, the ambient color in the room, the reflection 
coefficients of the object the direction. U of the light source, the direction. V. as shown, of the eye 22. and the surface 
nonnal, N. at P. For a given light source and afixed viewing direction, only the oljject color and the surface normal vary 
over the surface of the object Accurate estimation of surface normals is essential for realistic rendering. 
[0028] More particularly, rt will be appreciated that the intensity of the light at each pixel of this image plane includes 
a conponent due to reflectance from the object surface. The refelectance intensity at point PI fe affected by the viewing 
direction V^, from the image plane 20 to the object 22; the fighting direction, from the fight source 24 to the point 
where the viewing ray intersects the object; and the surface nomial, N^, at that point 

[0029] In one ©nbodiment. with the object being a cup. that which is necessary to accurately render the cup is to be 
able to obtain the intensity, fight direction and color of a point on the cup. As to image plane 20. if one can establish a 
nomial to point Pi then one can 6^cnbe the magnitude or intensity of fight from that point as it relates to the viewirig 
direction and the fighting directioa Since the voxel at point Pi contains infonnation as to color and intensity, all that is 
necessary to establish is the nonral at point Pi to properly establish the intensity and color of a corresponding point on 

50 the image plane. ^ ^ ^ ^ « o>i 

[0030] Referring to Rgure 3A. in polygon modeling, graphical ol)iects are represented by surface polygons. e.g. 24. 
26 and 28 When rendering polygonal models, surface ifiununation at a point P. 30. is calculated from the viewing direc- 
tion V. 32 the lighting direction. U 34, and an estimate, N. 36. of tiie surface nomial at the point P, 30. using an illumi- 
nation model such as the Phong illumination model. Referring to Rgure 38. typically, accurate surface normals for the 
object are stored in tiie object model at the polygon vertices. 40. 42. 44. 46 and 48. Typically, the surface nonnal, N. 50, 
at the sample point P. 38, is estimated from the stored surface normals at the vertices of polygon 52 on which the sam- 
ple point lies. ^ , ^ ^ ^ ^ 
[0031] Referring to Rgure 4. in ray casting for VoliHue Rendering, rays are cast into the volumetnc data from each 
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pixel in the view plane 54. Each ray is sampled at equally spaced intervals as rt traverses the volume 56. At each sample 
point the object color 58, transparency 60. and surface normal 62. are estimated. These are used along vnth an illumi- 
nation model to calculate the fight reflected at each sample point 64. Once the odor of each sample point is known, it 
is composited onto the ray color 66. 

[0032] Refemng to Rgure 5A. rays from the view plane. e.g. 68. 70 and 72. are cast into the volume in the viewing 
direction, sampling the color of the volumetric data at equally spaced intenrals. eg. 74 and 76 and compositing the sam- 
ple color onto the ray color. Referring to Rgure 5B. in high quaWy Volume Rendering which uses an illumination model, 
the color of each element includes a component due to light reflected by the sample element. Ttie color of the reflected 
light B calculated using an OluminaCon model such as the Phong illumination model, and the resultant light color at the 
sanple point P. 78. depends on the direction. U 80. of the light source, the direction. V. 82. of the viewing direction, and 
the surface normal. N. 84 at P. 78. Unlike polygonal models, accurate surface nomwls are not usually stored in the vol- 
umetric data. Hence, the surface normal. N. 78. at the sample point must be calculated from the density values stored 
in data elements near the sanple point. Referring to Figure 6A. typically, in Volume Rendering, each element in the vol- 
ume has a structure such as the one shown here, written in the C programming language. Each element contains a 
value 86 for the object density or intensity. Referring to Rgure 6B. in the subject invention, the data structure for each 
element has an additional f ield 88 so that a value for the distance to the nearest surface can be stored for each element. 
In the subject invention, this distance is used to detect the presence of a surface and to estimate its nomel direction 
In one embodiment the distance is positive inside of the object negative outside of the object and zero on the object 
surface. The gradient of this distance field points In the direction of the surface nomial. Surface are detected where the 
magnitude of the distance is below a small threshold. , . w. d 

[00331 Referring to Rgure 7. differences between the prior art for estimating surface normals in Volume Rendering 
and the method of the sut^ject invention are iHuslrated in 2D. 7(a) is a 2D object. The object is present where the image 
is black as illustrated at 90. and absent where tl is white, as illustrated at 92. Rgure 7(b) is the continuous distancen^P 
that corresponds to the object In Rgure 7(a). Note that it has a value of 0.5 on the surface, or edge, of the 2D object 94; 
values that Increase with distance from the surface and ranging from 0.5 to 1 inside the object and valu^ that decre^e 
with distance from the surface and ranging from 0.5 to 0 outside of the object. Rgure 7(c) is the sampled version of Rg- 
ure 7(a) where sample points are black if they fall inside the object e.g. 96. and white if the fail outside of the object, 
e g 98 Rgure 7(d) is the sampled version of Rgure 7(b). where the value of each sample point is the color of the dis- 
tance map at the same position. Notice that the intensity values of the sample points in Rgure 7(d^ vary smootWy 
across ttie image. Because of this smooth variation, values of the distance field that lie between sample points ran be 
reconstructed more accurately and with a lower order interpolation filter than values of the sanpled in«ge density field 
of Figure 7(c) can be reconstnicted. Figure 7(e) is a sampled estimate of the gradient field of F'g"''® 7(a) that vras cal- 
culated from the sampled image of Rgure 7(c) using a central difference gradient estimato. Note tha^ fl^'^l^^" f 
the sample gradients can vary signmcantiy for neighboring samples. e.g. 98 andlOO. or -^^^^ 
ent estimate in Volume Rendering would cause signrficant artifacts in the image. Rgure 7(f) is an estimate of tiie surface 
nomial directions of Rgure 7(a) calculated using a central difference gradient estimator from the sampled in^e of Fig- 
ure 7(d) The direction of the surface estimate Is consistent throughout Figure 7(f) and ft accurately reprints the rjor- 
mal of the 2D otjject surface. The magnitude of the surface nomial can be derived from the distance irop in Figure 7(d) . 
In this exanple. the surface nomial magnitude is large when ttie distance map intensity is close to 0.5 and small ottier- 

IoW41 Referring to Figure 8. there are different ways to calculate an objects distance map 106. depending on ttie 
object representation 108. H the object is represented implicitiy or parametrically as at 1 10. such as *e equation da 
sphere or a spline patch, then either geometric reasoning or constrained optimizatron 1 12 «n be ^^^^ to f^^ ttie mirh 
Unum distanoB from any point in the volume to ttie defined surface. If tiie object is represented by a pdj^onal su^e 
model 114 various algorithms used in graphical coirision detection can be used to calculate ttie distance from a^ 

in volume to ttie nearest surface polygon 116. For a discretely sampled continuous der«ity field ^^^-^^"^^ 
generate distance measures would be to construct a polygonal surface model at iso^"f *t 
culate distances from ttiis constnicted surface 116. For a binary segmented object tt^e birwy 
smoottied as niustrated at 1 24 to form a continuous sampled density field and ttien treated as above as nitrated at 
120 and116. or Eudidean distances could be calculatedfrom binary segmented data 126. The resultart distance 

could also be filtered to obtain a snrwother distance field 1 28. • 
10035] A program listing in C is presented hereinafter to fliustrate the utilization of the subject system for use in gen- 
erating fighting effects for volume rendering: 
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volRender ,c 



10 



fiasic volume rendering program. Takes a data volune consisting of an 
intensity and a distance-to« surface measure for each voxel and projects 
the volume onto a 3D image. 
Revised from earlier projection programs. 

Calculates object color, and transparency using the voxel intensity values 
and shading based on a central difference of the distance values. 
Compositing is done in front- to-back order and terminates at a max opacity. 

July. 1997 by S. Gibson, - 
MERL Cambridge. 



15 



/• includes */ 
Cinclude "volRender .h" 



20 



25 



/• vis.DiBplay global variables */ 

static int xSize. ySize. zSiie; 

static int imgSize; 

static int nLights; 

static int vert^xOf f set (8| ; 

Static float voxelSizeX. voxelSizcY, voxelSizeZ; 
static float scaleX, scaleY, scaleZ; 
Static float R{3)C3K T(3); 

static float kd, ks, specularExp, visibility; 
static float ImageGain; 

static VisLight lights (MAXLIGHTS) ; 
static VisFVector view; 



30 



main — 



void main (int argc, char 

35 ciwr dataFileNamo(60) ; 

ciiar clutFile*lame(60) ; 
char tlutFileName(601 ; 



•argv) 



40 



45 



SO 



int i. j, k. index; 
int size, imgArea: 
int fd. n; 

XEvent event; 

VisVoxel * voxel; 
VisColor *cliftrJin«ge; 
VisFColbr * image; 
VisColorLut clut; 
■ VisTranspLut tlut; 



/• 3D data volume •/ 
/• projected image (char) */ 
/• projected image (floating point) •/ 
/• array of- color lookup tables •/ 
/* array of transparency lookup tables •/ 



/* initialize the rendering parameters */ 

InitProjection(ergvllI , dataFileWame. clutFileName . tlutFileName) ; 



/* allocate space for the data and image arrays •/ 
size « xSizc * ySize ' zSize; 
voxel « (VisVoxel *) malloc(size 



* sizeof (VisVoxel) ) ; 
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imff^lrca = inySize ' imgSii-; 

ijnage = (VisFColor *) mallocCimgArea * sizeof (VisFColor ) I ; 
. charlinaae «r (VisColor *) mall oc(iinff Area • sixcof (VisColor) ) ; 

^ /• opeu and read the data file ♦/ 

fd e open(dataFilcName, O.RDONLY) ; 
readCfd. voxel, size * sizeof (VisVoxel) ) ; 
close (fd); 

/-^ clear the iroafie to black •/ 
^0 VisClearlmaffetimacje) ; 

/• render the volume data */ 

Vi sPr eject (voxel . clut, tlut, iiaage) ; 

/* scale the colors of the image to chars, correct for overflow ♦/ 
ColoreToChar (image, charlroage. imgArea); 

Id 

/* write tJie image to a file */ 
. f d creatCimoge.raw-. PMODE) ; ^ i 

write (fd, char Image. imgSiie * imgSize • sizeof (VxsColor) ) ; 
close(fd} : 

20 /♦ free the data allocation •/ 

free ( (VisVoxel * ) voxel ) ; 
free ( (VisFColor * ) ifnagc) ; 
free ( (VisColor *) chorlmage) ; 



25 



30 



VisProject — 

This procedure calculates the projected iraage by casing rays from the 
image plane throught the object, calculating the gradient color 
transparency, and shaded color contribution from each sample poxnt 
along the ray and then compositing these values in a fxont-to-back 
ordering . 



35 



40 



45 



50 



VisProject (VisVoxel -voxel. VicColorLut clut, Vi?Transpl*ut tlut. 
VisFColor •image) 



( 



int i, j. ii. jj* 
int index, nindex; 

int planeSlze; *I . • 

int neighborlndexlB) , values (81; g 

float x, y. z; 

float dx, dy. dz, ddx. ddy. ddz; 
float tempo, tempi. t€mp2 . temp3; 
float w(8): 

float tranep. opacity. accTransp; 
float mag. sign, diet; 

VisFColor color. shadingColor ; 
VisFVcctor grad; 

planeSize = xSizc * ySize; 

/• 1) calculate contributions to the image plane by ^"^P^^Xr^""^ ' ""^^ 
* through Uie data in the kk direction xn front-to-back ord-r 
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15 



20 



25 



30 



35 



40 



45 



2) tor each pixel (ii.ji) in the image plone, 1) find the 

corresponding coordinates <x.y,z) in the data volume for the kkth 
sample point along the ray. 2) trilinearly interpolate attributes 
of the sample point from the surrounding neighbors. 3) accumulate 
the color along the ray by compositing the color of the sample 
point onto the image plane pixel. 

"/ 

index « 0; 

for Cjj « 0; jj < imgSize: ( 
for (ii = 0; ii < imgSiie; ii*+) i 
accTransp =1.0; 
kk = 0; 

color. r = color. g = color. b = Q.O; 
transp = 1.0; 

while ((kk < img.Size) At (accTransp > 0.001) ) ( 

/* 3) calculate the (x.y.z) coordinates of (ii.jj'kk) in image space V 
X = R(OJ(OJ - ii + R(0J(1I • jj + n(0l(2l * kk + T(OJi 
y = R(13|0| * ii * nUJdJ * jj + njl3(2J * kk ^ T{1] 
I = R[2)(0! * ii * R(2|(l) ^ jj * n(2]l23 * kk * T(2J 

/* make sure the (x.y.z) lies inside of the data volume */ 
if ( (x >= 0) tt (X < xSize-1) 

(y >= 0) tA (y < ySize-l) tt 

(z >= 0} LL (z < zSize-1) ) ( 

/* 4) calculate coordinate dependent weights and constants */ 

i = (int) x; j = (int) y; k = (int) z; 

dx = x-i; dy = y-j; dz = z-k; 

ddx = 1-dx; ddy = 1-dy; ddz = 1-dz; 

tempo = dOx^ddy; tempi = ddx*dy; temp2 «= dx^ddy; temp3 - dx*dy; 

/* weights for trilinear interpolation where the indices correspond 

* to the neighbors in the following way: 0->000. l-J-OOl, 2->010, 

• 3->011, 4->100, 5->101. 6->110, and 7->lll. 

w(OJ = ten^O-ddz; wIU = tempO'dz; wC2J = templ*ddz; wI3J = templ-dz; 
w|4] = teii«>2*dd2; w(5J = te«p2*dz; w(6J ^= temp3-ddz; w(7) = temp3*dz; 

neighborIndcx(OJ « i + j*xSize ♦ k*pl«neSize; 

dist = VisCctSampleDist (voxel, w, neighborlndex(0 J ) ; 

if (dist >= -0) ( /* odd color only for interior elements * / 

/* indices of B surrounding voxels where the indices correspond to 

* the neighbors in the following way^ 0->000. 1->001, 2->010, . 

* 3->011. 4->100. 5->101, 6->110, and 7->lll. 
•/ ' 

for (nlndex = 1; nindex < B; nlndex»-+) ( 
neighborlndex (nlndex J = 

neighborlndex(0| + vertexOffsetlnlndcxI ; 

) 

for (nlndex = 0; nlndex < B; nlndex++) ( 

values (nlndex] « (int) voxel (neighborlndex ( nlndex] 1 . value ; 

J 



50 



* 5) calculate the gradient, color, transparency, and shaded 

• color of the sample point from the surrounding neighbors. 
*/ 

VicCetSampleColor (values, w, clut. tcolor); 
transp = VisGetSampleTransp (values , w, tlut); 
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if (nLighCs > 0) ( ... 

if (Hiag c VisGetSaii9)leCrad (voxel, y; i, j. Jc. Agrad) >= 0) ( 
. /• find direction of grod relative to the view direction. 

* If positive, this sample point contributes to the shaarnc 

*/ 

sign = VectorOot (grad, view) ; 
if (sign >= 0) ( 

shadingColor = color; 

VisGetShadedCoior (grad, mag. tshadmgColor) ; 

color. r shadingColor .r; 
color. g +^ shadingColor .g; 
col or. b shadingColor .b; 



) 



) 



) 



) 
) 

) 

index++; 



/* 6) project the voxel onto the view plane 
iiMigelindexJ .r accTransp * color. r; 
image ( index] .g -»■= accTransp * color. g; 
image (index) .b accTransp ♦ color. b; 
accTransp * = transp; 



return; 

) 



VisCetSampleColor — 

This procedure gets the sample color by trilinearly interpolating the 
colors of its B nearest neighbors after tJiey. have been determined 
using a color lookup table . 



void 

VisGetSampleColordnt *values. float *weight. yisColorLut clut. 
VisFColor •color) j 

( 

int i; 

VisColor temp; 

color->r = color->fir = color->b « 0; 



for (i « 0; i < B; i++)- ( 

temp s= clut.color I values (ill ; 
color->r 4= visibility * weight (i) 
color->g 4= visibility • weightlil 
color->b *= visibility • weightlil 

) 



(float) 
(float) 
(float) 



temp 
temp 
temp 



255.0; 
255.0; 
255.0; 



return; 
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VlsGetSompleTransp 

This p-ocedure gets Che cample transparency |by trilinearay interpoletinff 
the transparencies of its B nearest neighbors after they have been 
determined using a lookup table. 



float 



VisGetSampleTranspdnt 'values, float •weight. VisTranspLut tlut) 



75 



20 



int i; 

float transp = 0; 

for (i = 0; i < B: ( • ' 

transp weightlil * tlut. transp(values (a J ) . 

) 

transp /= 255.0; 
return transp ; 



/♦ max char value is 255 */ 



25 



VisGetSampleOist — 

Tills procedure gets the sample distance by trilinearly interpolating 
the distance's to nearest surfaces of its B nearest neighbors. 



30 



float 



VisGctSampleDistC Vis Voxel *voxel. float -weight, int index) 



35 



int i; 

float dist = 0; 

for (i = 0; i < 8; i++) ^- - 

dist += weightdJ * voxel(index + vertexOf fsetii) J -dist; 



return dist: 



40 



45 



VisGetSampleCrad — j' 

This procedure gets the sample gradient from the distances of th« 
neigliboring elements using a central difference metnod. 



SO 



float 



VisGetSajnpleGrad(VisVox€l *voxel. float *weight, 
visGecbamp i^^^^ voxeil. int voxelJ. int voxelK. VisFVector -grad) 



int i. k. index; 
float mag: 
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/• apply central difference operator to trilinearly interpolated distances 
of the voxel's 6 nearest neigWiors to estjnate the image gradient */ 
note: samples must lie inside the data voJ^uxne 
if ((voxell > 1) Air (voxell < xSize-2) fcfc 
(voxelJ > 1) tfc (voxelJ < ySize*2) 
(voxelK > 1) <ct (voxelK < zSi2c-2)) ( 
index = 'voxell + voxelJ*xSixe ♦ voxciK*xSize*ySite; 

grodT>x = - VisGetSampleDist (voxel , weight, index + 1) + 

VisCetSampleDict (voxel , weipht. index - 1); 
grad->y = - visGetSampleDist (voxel . weight, index + xSize) + 

VisGetSampieOist (voxel, weight, index - xSize) ; 
grad->z = - VisGetSampleDist (voxel , weight, index + xSize-ySize) 

VisGetSaropleDist (voxel, weight, index - xSize*ySize) ; 

mag = sqrt(grad->x * grad->x + .grad->y ' grad->y -^ grad->z • grad->z) ; 

} 

else ( 

loag = 0; 

) 

if (jnag > 0) { 
grad->x /= mag; 
grad->y /= may; 
grRd->z /= mag; 

) 

else ( 
mag = 0; 

grod->x = grad->y = grad->2 = 0; 

) 

return mag; 



VisGetShadedColor — 

This procedure calculates shaded color using a Phong shading algorithm 
with diffuse and specular reflection. ' 



void ViRGetShadedColor (VisFVector grad, float mag'. VisFColor *color) 
^ . . 

int i; V 
float dScale. temp, sScale; 
VisFColor shadeColor; 

shadeColor.r = shadeColor. g = shadeColor. b =0; 

if (visibility l« 0) ( 

for <i = 0: i < JiLights; i-»-^J ( 

/* get the diCfuse ligliting Kcoling factor */ 
temp s VectorOot (grad. lights (i) .lightVector) ; 
if (temp > 0) 

dScale « wag • kd • temp; 
else 

dScale =0; 

/• get the specular light scalijig factor. Note the use of the halfway 
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• vector assumes that tJie light and the viewing position are infinitely 

* far away (see Foley, Van Dam. eU al.). 

tcnip « VcctorDot (grod. lights (i) -hwVcc tor) ; 
'if (tenip > 0) 

sScale = mag • ks * pow(temp. specularExp) ; 
else 

sScftle = 0; 

sUiideColor.r *= visibility * lightsfij.r *-.(dScale • color->r * sScale); 
shndeColor.g visibility • light*(i).g * (dScale * color->g + sScale) : 
shodeColor .ia visibility lights (i J .b * (dScale * color->b + sScale); 

) 

) 

•color s= shadeColor; 
return; 

) 



[0036] Having above indicated several embodiments of the Subject Invention, it will occur to those skilled in the art 
that modifications and alternatives can be practiced witWn the spirit of the invention. H is accordingly intended to define 
the scope of the invention only as indicated in the following claims. 

Claims 

1 . In a volumetric data representation system for graphical objects in which graphical objects are generated from data 
elements, 

means for encoding the distance of a data element to the nearest object surface point; and. 

means responsive to the distance of said data element to the nearest object surface point for estimating a sur- 
face normal thereof. 

2. The system of Claim 1 , and further including means responsive to the distance of said data element to the nearest 
object surface point for estimating the magnitude of said surface nomial. 

3 The system of Qaim 1 , wherein said distance encoding means includes means for generating a disaete volumetric 
distance map and means for generating a gradient vector at any point in the space that contains said surface from 
said distance map, sad gradient pointing in the direction of a surface normal. 

4. The system of Qaim 3. wherein a zero distance map value indicates the presence of a surface. 

5. The system of Qaim 3, wherein a positive distance value indicates that said data element is inside said object 
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Fig. 1 
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Fig. 3A 
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FOR EACH PIXEL IN THE VIEWING PIAH£ 



CAST RAYS INTO THE VOLUME 
54 



SAMPLE VOLUMETRIC DATA 
AT INTERVALS ALONG THE RAY 
56 



AT EACH SAMPLE. 



58 — 



INTERPOLATE OBJECT COLOR 



60- 



INTERPOIATE OBJECT TRANSPARENCY 



62 ESTIAAATE OBJECT SURFACE 



USE *"* •* SURFACE INFORMATION 
bA - MODEL TO ESTIMATE THE 

■ REFLECTED LIGHT 



66- COMPOSITE SAAAPLE RESULT ON RAY COLOR 



Fig. 4 
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TYPE.DEF VOLUAAE ELEMENT STRUCT { 

06 -INT DENSITY; 

} VOLUME ELEMENT; 



Fig. 6A 



^ TYPE DEF VOLUME ELEMENT STRUa { 
INT DENSITY; 

88 INT D6TANCE; 

} VOLUME ELEMENT; 



Fig. 6B 
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Fig. 7A Fig. 7B 
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Fig. 7C 
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Fig. 7D 




Fig. 7E 
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Fig. 7F 
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OBJEa REPRESENTATION DISTANCE CALCUIATION 



DISTANCE ^^AP 
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IMPLICIT/ 
PARAMETRIC 
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POLYAGONAL 
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114 



SAMPLING 
CONTINUES 



T 
118 



BINARY 
SAMPLING 
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GEOMETRY/ 
CONSTRAINED OPTIMIZATION 



112 



DISTANCE TO CLOSEST POLYGON 
(FROM PHYSICS-BASED GRAPHICS) 
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ISO SURFACE 
GENEP.ATION 
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SMOOTHING 
FILLER 
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MAP 
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Fig. 8 
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